Papers by Michael S Ryoo
Too Many Frames, Not All Useful: Efficient Strategies for Long-Form Video QA (2026.eacl-long)
Copied to clipboard
| Challenge: | Recent studies leverage large language models (LLMs) in LVQA benchmarks, achieving exceptional performance while relying on vision language models to convert all visual content into natural language. |
| Approach: | They propose a modular and training-free framework that leverages large language models to generate a small subset of informative frames tailored to each question. |
| Outcome: | The proposed framework achieves state-of-the-art performance among similar models across four benchmark LVQA datasets: EgoSchema, NExT-QA, IntentQA, VideoMME. |
Language Repository for Long Video Understanding (2025.findings-acl)
Copied to clipboard
| Challenge: | Language-based learning models (LLMs) support long context-lengths but their effectiveness in handling long-term information gradually declines with input length. |
| Approach: | They propose a Language Repository (LangRepo) that maintains concise and structured information as an interpretable representation. |
| Outcome: | The proposed framework is evaluated on zero-shot visual question-answering benchmarks. |
LAM SIMULATOR: Advancing Data Generation for Large Action Model Training via Online Exploration and Trajectory Feedback (2025.findings-acl)
Copied to clipboard
Thai Quoc Hoang, Kung-Hsiang Huang, Shirley Kokane, Jianguo Zhang, Zuxin Liu, Ming Zhu, Jake Grigsby, Tian Lan, Michael S Ryoo, Chien-Sheng Wu, Shelby Heinecke, Huan Wang, Silvio Savarese, Caiming Xiong, Juan Carlos Niebles
| Challenge: | Large Action Models (LAMs) face challenges due to the need for high-quality training data, especially for multi-steps tasks that involve planning, executing tool calls, and responding to feedback. |
| Approach: | They propose a framework for online exploration of agentic tasks with high-quality feedback . they use a dynamic task query generator and an extensive collection of tools to create a high-level feedback environment for LLM Agents. |
| Outcome: | The proposed framework achieves 49.3% performance improvement over baselines on toolbench and CRMArena. |